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(57) ABSTRACT 

An apparatus and method for automatically tracking an 
object is provided. The apparatus for performing the method 
includes a camera having a zoom lens, an automatic focus 
lens, and a charge coupled device for converting an image of 
an object input via the lens into electrical signals. The 
camera is mounted on a camera supporter to rotate the 
camera around a first axis and the axis perpendicular to the 
first axis. The supporter includes holes and sensors for 
detecting the rotational limit of the camera in the horizontal 
and vertical directions. A pan/tilt controller detects a motion 
vector of the object, and controls the camera to move in the 
direction and degree corresponding to the detected motion 
vector. A zoom focus controller performs a zooming opera- 
tion to expand an object search region of the camera 
whenever the camera reaches the limit of the rotational 
range in at least one direction, and adjusts an automatic 
focusing lens. A system controller connected to the pan/tilt 
controller and zoom/focus controller initializes a camera in 
order to automatically track a moving object and controls the 
operations sequence of each functional block. 

10 Claims, 7 Drawing Sheets 
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FIG. 1 
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FIG. 3A 
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FIG. 4 
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METHOD AND APPARATUS FOR sequential unit images with each other, detecting a motion 

AUTOMATICALLY TRACKING A MOVING vector of the object, generating camera control signals 

OBJECT corresponding to the detected motion vector, and controlling 

the camera to track the moving object; (b) checking whether 

5 the camera reaches the limit of rotation range of the camera; 

BACKGROUKD OF THE INVENTION and (c) performing a zooming operation in the direction of 

. - • , expanding an object search region of the camera until the 
nje present .nventjon relates to an apparatus and method positioned within a predetermined effective region 

for automalicaUy tractang a movmg object, so that the object ^^^^^^^^ determined that the camera reaches the limit 
>s always positioned in front of the lens of a camera by j„ ^^^^^ 

controlung the camera. ^ . . . 

, . , ^ . . , . . To accomplish another object of the present mvention, 

Id a general video conferencmg system, a video telephone j^ere is also provided an apparatus for automaticaUy track- 

and a monitonng system, a camera picks up an miage of an ^ ^ ^^ject. the automatic tracking apparatus com- 

object which is transformed as a video signal. The picked-up nrisine* 

video signal is transmitted or stored in a recording medium, m . , j. , , . r 

As each of the above systems were introduced, the camera , ^ '^f""" ""^ly^^g ^ l"^ an automaUc focus 
was fixed to the main body of each system. Thus, when an convertmg an image of the object inpu through the 

r.w..^ ,„,o ;„ f,««. «f .i,- o a... .-.o lenses mto an electrical signal; a camera support unit includ- 

object was not positioned in tront of the camera due to its . , . u - I .i. • . j r 

. 11 J- . J .L r .L me a camera driver on which the camera is mounted, for 

movement, a user manually adjusted the position of the f ,u . c . • j ^"'^>^, 

system body itself or the camera itself, in order to direct the camera around a first axis and a second axis 

camera toward the object so that the latter was positioned in P^H^ndicular to the first axis and a rotation hmit detector for 

«f tu^ i™,- ' tf- « detecting whether the camera reaches one of the limits of the 

iront 01 the camera lens alio wmg its image to be picked up. . . j. . . . , . 

rotation range of each direction and outputting a detection 

However, when a user moves durmg dialog in the video ^-^ ^i^^ ^^^^^ ^^^^^^ ^ y^^^ ^he rotation range; a 
conferencmg system or video telephone, the above manual controller for comparing a current unit image output 

repositionmg of the camera causes the user to be conscious 25 ^^mera with a previous unit image, detecting a 

of the camera. The user must also directly adjust the camera ^^^^^ ^j^j^^^^ controlling the camera drive 

while watching the monitor, which causes inconvemence ^ ^^^^ came ra moves in the direction and degree 

durmg use of the systems. ^ c^res pondcnce^ the motion vector: and a second 

To solve these problems, a conventional apparatus controller for adjusting the zoom lens in the direction of 
includes a camera driving device for rotating a camera in a 30 expanding an object search region of the camera whenever 
horizontal or vertical direction, and a motion detector for a detection signaCindicating that the camera has reached a 
detecting a motion of the object. The camera automatically limit of the rotation range, is activated, thereby allowing the 
rotates in the direction of the detected motion. The degree of camera to track the moving^ghject^^nd adjusting an auto- 
rotation also corresponds to the degree of detected motion. matic focusing lens using a luminance component of the 
The camera driving device includes two motors for rotating 35 ^jjag^ received in ±6 camera, 
the camera in a horizontal or vertical direction. The motion 

detector detects a motion vector of the object from sequen- BRIEF DESCRIPTION OF THE DRAWINGS 

tial unit images obtained by a picture tube, using a weU- The preferred embodiments are described with reference 

known block matching algorithm (BMA). The apparatus to the drawings, wherein 

generates motor drive signals having the direction and pic. 1 is a block diagram showing an automatic tracking 

magnitude which correspond to the detected motion vector camera apparatus for automatically tracking a moving object 

of the object, and controls the camera so that the object is according to a preferred embodiment of the present inven- 

positioned in front of the camera lens. Thus, the method for tion* 

automaticaUy adjusting the camera according to the move- 2A is a side view of the automatic tracking camera 

ment of the object reduces the inconvenience of using the « ^ ^^^^^ gjjown in FIG. 1; 

video conferencing and telephone systems. ™^ . , . ^ , . i • 

^ f J pjQ 2B is a sectional view of the automatic tracking 

However, in the above automatic method, the camera camera apparatus of FIG. 2A along the line 2B— 2B; 
cannot track the object when the object is beyond the range ^,^3 3 33 3^ flowchart diagrams for explain- 
dirrctiol ' horizontal or vertical o^^.^M^^ of the apparatus shown m FIG 1; 

FIG. 4 is a conceptual view for explaining a process for 

SUMMARY OF THE INVENTION obtaining a displacement of the camera from the position 

component of the moving object on the image plane jc; 
To solve the above problems, it is an object of the present 5 ^^^^^ ^ iti^^j ^t which the object is searched on 

mvention to provide a method for expanding an object 55 the screen when the camera performs a zooming operation 

search region of a camera usmg a zooming operation. A ^jep by step in the direction for expanding the search region 
conventional automatic camera control method is performed camera* 

when the camera is within a carnera rotation range, and a p,^ ^ ^^^^ ^„ ^^^^^^ ^^^^^ 

zooming operation IS performed to adjust the object search embodiment of the present invenfion. 

region when the object is beyond the camera s rotational gQ ^ 

range. DETAILED DESCRIPTION OF THE 

It is another object of the present invention to provide an PREFERRED EMBODIMENTS 

apparatus embodying the above method. Preferred embodiments of the present invention will be 

To accomplish the above object of the present invention, described in detail with reference to the accompanying 

there is provided a method for automatically tracking a 65 drawings FIGS. 1 through 6. 

moving object by controlling a camera, the automatic object FIG. 1 shows a block diagram of an automatic tracking 

tracking method comprising the steps of; (a) comparing camera apparatus for automatically tracking a moving object 
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according to a preferred embodiment of the present inven- First, the hole 12 provided in the pan motion carrier 11 is 

tion. The apparatiis includes a camera 1 for capturing an used for detecting the rotational limit of the camera 1 in the 

image of the object and converting the image into electrical horizontal direction together with two pairs of position 

signals. The camera 1 includes a lens unit having a zoom sensors 13 and 14, Here, the hole 12 rotates along with the 

lens (not shown) and an automatic focus (AF) lens (not 5 rotation of the pan motion carrier 11. Also, each position 

shown), and a charge coupled device (CCD) (not shown) for sensor includes a light emission portion "a" disposed on the 

converting optical image signals input via the lenses into inner side of the pan motion carrier 11 for generating light, 

electrical signals. A camera supporter 2 on which the camera and a light receiving portion "b" disposed on the outer side 

1 is mounted includes a pan motor 3 for rotating the camera of the pan motion carrier 11, for sensing light generated by 

1 in the horizontal direction and a tilt motor 4 for rotating the the light emission portion "a". The position sensore are fixed 

camera 1 in the vertical direction. to the base corresponding to the left end and the right end of 

Apan/tilt controller 5 which is connected to the pan motor the angle A. Thus, when the hole 12 reaches the left end or 

3 and the tilt motor 4 controls driving of the pan motor 3 and right end of the angle A according to the rotation of the pan 

the tilt motor 4 in correspondence to movement of the motion carrier U, the position sensors 13 and 14 and the 

object. For this purpose, the pan/tilt controUer 5 obtains a hole 12 lie in a straight hne. At the same time, the Ught 

motion vector of the object, and calculates an angle for the fr^„ tu^ u„ut ♦t,™,™^, 

^ . j'.tL- 1. ., commg irom tiie ugtit emission portion a passes ttirougn 

camera 1 to be rotated in the horizontal and vertical Kr»u i-^ ^1^*^^*^^ :„ tk^ i:„u* ,™:„:„„„^^^^ 

directions, using the obtained motion vector. Then, the JJ^ hol^ 12 ^s detected m th^^ . 

pan/tilt controUer 5 generates motor drive pulse signals, '^^^'"T^ P°^^^^VL °^^P"»^, ^ 

Corresponding to the (Erection and size of the motion ^ctor, mdicating that the camera 1 has cached a rotational 

to move the camera 1. These generated motor drive pulse 20 limit position^By this prmaple a pjm left-end (^^^^^^ 

signals are output to the pan motor 3 and the tilt motor 4. As ^ detects the left-rotational Umit of the 

a result, the pan motor 3 rotates the camera 1 in the camera 1 and a pan right-end (PRE) sensor 14 detects the 

horizontal direction, that is, in the left or right direction with right-rotational limit. 

respect to the front of the lens of the camera 1. At the same Also, the hole 17 provided in the tilt motion carrier 15 is 

time, the tilt motor 4 moves the camera 1 in the vertical 25 for detecting the rotational limit of the camera 1 in the 

direction, that is, in the up or down direction with respect to vertical direction together with two pairs of position sensors 

the front of the lens of the camera 1. 18 and 19. Here, the two pairs of position sensors 18 and 19 

Meanwhile, the zoom/focus controller 6 shown in FIG, 1 have the same strucmre and function as those of the above- 

performs a zooming operation such as a zoom-in or zoom- described sensors 13 and 14. The position sensors are a tilt 

out operation by adjusting a zoom lens of the camera 1 3Q upper-end (TUE) sensor 18 for sensing the upper rotational 

according to output signals of end-position sensors 13, 14, limit and a tilt lower-end (TLB) sensor 19 for sensing the 

18 and 19 shown in FIGS. 2A and 2B. These sensors are lower rotational limit, which are fixed to the respective 

installed in the camera supporter 2. Here, the end-position positions corresponding to the upper rotational limit and the 

sensors 13, 14, 18 and 19.detect the limit of the rotation lower rotational limit of the angle B. The method for 

range between which the camera 1 can rotate in the left or 35 detecting the vertical rotational limit of the camera 1 using 

right (horizontal) direction or in the up or down (vertical) the two pairs of position sensors 18 and 19 and the hole 17 

direction. When the zooming operation completes, the zoom is the same as that for detecting the horizontal rotational 

focus/controller 6 adjusts an AF lens of the camera 1 to limit of the camera 1. 

automatically focus at a focal point, using a luminance FIGS. 3A,3B and 3C are flow-chart diagrams for explain- 

component of the image input to the camera 1. 40 ing the operation of the apparams shown in FIG. 1. In the 

Also, the FIG. 1 apparatus includes a system controller 7 whole operational flow-chart referring to FIGS. 3A, 3B and 

connected to the pan/tilt controller 5 and the zoom/focus 3C, steps 310 through 360 are a main routine of a program 

controller 6. The system controller 7 initializes the FIG, 1 embodying the present invention and steps 370 through 376 

apparatus and generaUy controls the operational sequence of corresponds to a subroutine of the step 360. The above first 

the respective functional blocks. 45 steps 310-330 initiaUze an apparatus for automatically 

FIGS. 2 A and 2B show the mechanical structure of the tracking a moving object, steps 340-350. detect a motion 

FIG. 1 apparatus. The camera 1 includes a lens unit 8 and vector of the object, and step 360 makes the camera 1 move 

can rotate around a first arbitrary axis and simultaneously in the direction and degree in correspondence to the detected 

rotate around a second axis perpendicular to the first axis. motion vector in order to track the object. The steps 371a, 

The camera supporter 2 enables the rotational movement of 50 372a, 373a, and 374a adjust a zoom lens so that a search 

the camera 1. The camera supporter 2 includes a mount base region of the object is expanded to a predetermined effective 

9 and a pan motion carrier 11 mounted on the mount base 9 region whenever the object is beyond the rotational limit of 

and connected to the pan motor 3 shown in FIG. 1 via a pan the camera 1 using the tracking procedure of steps 330-370. 

shaft 10. Here, the pan motion carrier 11 rotates the camera By expanding the effective region for tracking, automatic 

1 in the horizontal direction within the range of an angle "A" 55 tracking of the object can continue even if the camera has 

according to the rotation of the pan motor 3. Also, a tilt reached one of its rotational limits, 

motion carrier 15 is connected to the till motor 4 via a tilt Referring to FIG. 3A, the system controller 7 applies an 

shaft 16, and is mounted on the upper portion of the pan initialization command to the pan/tilt controller 5 and the 

motion carrier 11. Here, the tilt motion carrier 15 rotates the zoom/focus controller 6, in order to initialize the apparatus 

camera 1 within the range of an angle "B" in the direction eo for automatically tracking the moving object. The pan/tilt 

perpendicular to the rotational direction of the pan motion controller 5, which receives the initialization command from 

carrier 11. the system controller 7, adjusts a horizontal angle and a 

Also, the camera supporter 2 of the FIG. 2 apparatus vertical angle of the pan motion carrier 11 and the tilt motion 

includes holes 12 and 17 and sensors 13, 14, 18 and 19 for carrier 15 to zero relative to a reference point, and controls 

detecting the rotational range of the camera 1 in the left or 6S the lens unit 8 of the camera 1 to be directed towards the 

right (horizontal) direction or in the up or down (vertical) firont center (step 310). The zoom/focus controller 6, which 

direction. receives the initialization command from the system coo- 
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troller 7, initializes the zoom lens and the AF lens so that the 
camera 1 has the minimum focal distance (step 320). 

When the initialization step is completed, the system 
coDtroller 7 controls the camera 1 to detect an initial image 
frame of the object (step 330), and then to detect a subse- 5 
quent image frame of the object (step 340). When the two 
sequential image frames of the object have been detected, 
the pan/tilt controller 5 obtains a motion vector correspond- 
ing to a difference between the two sequential image frames 
under the control of the system controller 7, Here, the jq 
motion vector can be obtained by a separate video processor 
(not shown), rather than the pan/tilt controller 5. 

Ageneral image signal handled in the video telephone and 
the video conferencing system is composed of many back- 
ground images which are relatively still. A movement of the 15 
objea is rather small in the image. As described above, in 
the case where the movement of the object image is rela- 
tively small, the relationship between the two sequential unit 
images has a relatively large correlation. A well-known 
block matching algorithm (BMA) is used as the method for 20 
obtaining a motion vector of the object in a particular unit 
image signal. The BMA divides the image signal of a display 
unit screen into magnitude blocks of a predetermined unit, 
and finds a block which is the most similar to a current block 
to be encoded from the previously input image signal of the 25 
display \mii screen. The BMA is disclosed in detail in U.S. 
Pat. No. 5,173,772 to Choi and assigned to Samsung Elec- 
tronics Co., Ltd. The present invention uses the BMA to 
calculate a motion vector of the object. 

Meanwhile, when the motion vector of the object is 30 
calculated, the pan/tilt controller 5 analyzes the calculated 
motion vector and judges whether or not the object moves 
(step 350). In the step for judging object movement, if the 
calculated motion vector has a magnitude of a predeter- 
mined value or more, the pan/tilt controller 5 judges that the 35 
object has moved. If the calculated motion vector has a 
magnitude less than a predetermined value the pan/tilt 
controller 5 judges that the object hasn't moved If it is 
judged that there is no movement of the object, the program 
returns to step 340, and repeatedly performs steps 340 40 
through 350 until a movement of the object is detected. 

If it is judged that there is a movement of the object, the 
pan/tilt controller 5 generates motor drive signals corre- 
sponding to the motion vector and controls the camera 1 to 
track the moving object (step 360). The pan/tilt controller 5 45 
calculates a distance by which the camera 1 should move 
using the motion vector in order to move the camera 1 a 
distance corresponding to the distance that the object 
moved. Here, the distance that the camera 1 should move is 
proportional to the motion vector. Subsequently, the pan/tilt 50 
controller 5 generates motor drive signals corresponding to 
the calculated moving distance for the camera 1, and outputs 
the motor drive signals to the pan motor 3 and the tilt motor 
4. Here, the pan/tilt controller 5 can supply a particular 
rotational direction control signal to control a rotational S5 
direction of each motor corresponding to a motion vector of 
the object, or can control a rotational direction of each motor 
using the motor drive signal. The pan motor 3 and the tilt 
motor 4 both receive the motor drive signals and rotate in the 
direction and degree corresponding to a motion vector of the 60 
object according to the supplied control signals. Then, the 
pan motion carrier 11 and the tilt motion carrier 15, which 
rotate according to rotation of each motor, rotate the camera 
1 in the horizontal and vertical directions, in order to 
reposition the camera to compensate for the movement of 65 
the object. Thus, it is possible for the camera 1 to track the 
moving object. 
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FIG. 4 is a concepnial view for explaining a process for 
producing a displacement of the camera 1 based on the 
position component of the moving object on the image plane 
JL. First, the movement of the object on the image plane can 
be represented by the movement to the x-direction or 
y-direction on the image plane Ji shown in FIG. 4. Thus, the 
position of the object is t on the image plane Ji, the distance 
component of the object is represented by (x^ y,) and is 
converted into an angular component (aj)^ 6 J. This conver- 
sion is performed by the following known equations. (A 
video tracking system with adaptive predictors, Pattern 
recognition. Vol. 25, 1171-1180, 1992, by Chen and Chang): 

Here, f denotes a focal distance of the camera, (t^o, Bq) 
denotes a (liJ, 9) component of an initial optical axis of the 
camera. 

Meanwhile, using the calculated (ip^ 6^), a displacement 
(Ai|), A9) is calculated by the following equations: 

/cosflo / 

Here, f can be obtained from a process of focusing an 
image of the object by the camera lens. The pan/tilt con- 
troller 5 generates a vertical and horizontal motor drive 
signals in correspondence to the displacement and rotates 
the camera 1 in order to control the camera 1 to track the 
object. 

When the camera 1 tracks the movement of the object in 
step 360, the zoom/focus controller 6 checks the states of the 
limit position sensors such as the PLE sensor 13, the PRE 
sensor 14, the TUE sensor 18 and the TLE sensor 19 (step 
370). When the camera 1 tracks the object in step 360, the 
zoom/focus controller 6 detects whether the object is beyond 
the limit of the rotational range in the horizontal and vertical 
directions. 

Meanwhile, referring to FIG. 3B, the zoom/focus control- 
ler 6 checks whether the PLE sensor 13 installed at the 
left-hand rotational limit position of the pan motion carrier 
11 operates (step 371). In other words, if the camera tracks 
the object and reaches the left-hand rotational limit position, 
the hole 12 of the pan motion carrier 11 and the light 
emitting and light detecting components of the PLE sensor 
13 lie in a straight line, so that the output value of the sensor 
becomes "1**. In step 371, if the output value of the sensor 
is "1", the pan/tilt controller 5 cannot track the movement of 
the object any more with the camera in its present state. In 
this case, the zoom/focus controller 6 controls the zoom lens 
provided in the camera 1 by one step in the wide direction 
to thereby expand the object search region of the camera 
(step 371fl). If the zoom lens is adjusted in the wide 
direction, the apparent size of the object is reduced and the 
object search region of the camera is expanded. The object 
search region of the camera can be expanded to an adjust- 
ment limit in the wide direction of the zoom lens. 

Meanwhile, when the step 371a is completed, the zoom/ 
focus controller 6 judges whether the camera has reached the 
last zooming step (step 371A) in the wide angle or telephoto 
direction. The last zooming step corresponds to a zooming 
limit based on the characteristics of the zoom lens, where no 
zooming operation can be performed in the direction of 
expanding or reducing the object search region of the 
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camera. If it is judged that no more zooming can be video signal Processing then proceeds to the step 373 (to be 
performed while the object is not inchided in the effective described below) to check whether one of the vertical limit 
region (to be described below), the zoom/focus controller 6 position sensors 18 and 19 is operating indicating that the 
recognizes that the object is beyond the tracking range of the camera has reached a vertical limit position, 
zooming operation, and controls the process to return to step 5 Meanwhile, if the PLE sensor 13 does not operate to 
310 of the initial state (step 371c). detect that a left rotational limit has been reached, the 
FIG. 5 shows relative ratios that the object occupies on the zoom/focus controller 6 checks whether the PRE sensor 14 
screen when the zoom/focus controller 6 controls the zoom installed at the right-rotational limit position of the pan 
lens step-by step in the wide direction for expanding the motion carrier 11 (step 372) is operative. The PRE sensor is 
search region of the camera. The initial region I shows that jq activated if the pan motion carrier U, which rotates the 
an exemplary object, a person, is positioned to the left of the camera in the horizontal direction, rotates to the right- 
screen. Thereafter, the zoom/focus controller 6 controls the rotational limit position. When the PRE sensor 14 is 
zoom lens to perform a zooming operation one more step in detected, the zoom/focus controller 6 performs the steps 
the wide direction, the object search region of the camera is 372fl through 372e shown in FIG. 3B. The steps 372a 
expanded to a region II. In the region II, a ratio occupied by 15 through 372rf perform the same functions as those of the 
the object on the screen, that is, the magnitude of the object steps 371a through 2nXd. In step 372e, the motor is driven 
on the screen becomes small in comparison with the ratio one step to the left. The zoom/focus controller 6 performs a 
occupied in the region I. The position of the object also zooming operation if the object is beyond the right- 
moves toward the center of the screen. If the zoom/focus rotational range of the camera. As a result, the object search 
controller 6 controls the zoom lens to perform another 20 f^S^o^ 1^ camera is expanded to the predetermined 
zooming operation in the wide direction, the object search effective region to thereby track the moving object. If the 
region of the camera is expanded to a region III. In the object is properly tracked, the process proceeds to the step 
region III, the magnitude of the object on the screen 373 (to be described later) to check whether the object is 
becomes smaller still when compared with the magnitude of beyond the upper limit of the vertical rotational range, 
the object in regions I and II. The position of the object 25 itt© sensor is not detected in the step 372 following step 
moves further toward the center of the screen from the left 371, the object exists in the horizontal camera search range, 
thereof. As shown in FIG. 5, the zoom focus controller 6 The zoom/focus controller 6 checks whether the vertical 
checks the position of the object on the screen to thereby limit position sensors 18 and 19 are operated as shown in 
adjust the zoom lens one step by one step in the wide FIG. 3C to detect whether a vertical-rotation limit has been 
direction, until the object approaches the center of the 30 reached. 

screen. Referring to FIG. 3C, the zoom/focus controller 6 checks 

In this case, since the zoom/focus controller 6 judges whether the TUE sensor 18 is operative in order to sense 

whether the object approaches the center of the screen, a whether the limit of the upper rotational range of the tUt 

predetermined effective region is defined. Thus, it is judged motion carrier 15 has been reached (step 373), If not, the 

whether the object is included in the effective region. If the 35 zoom/focus controller 6 checks whether the TLB sensor 19 

object is not included in the effective region, the process is operative in order to detect whether the limit of the lower 

returns to step 371fl, and zooming is continuously rotational range (step 374) has been reached. If the TUE 

performed, as long as the last zooming step is not reached, sensor 18 or the TLE sensor 19 is activated, the camera 1 has 

until the object is included in the effective region (step rotated to the limit of the upper or lower rotational range in 

yild). The effective region includes the region where the 40 the vertical direction, and thus caimot track the moving 

screen object actually exists. The magnitude of the effective object. When one of the vertical limits have been reached, 

region should be set to be equal to or smaller than the size the zoom/focus controller 6 performs the steps 373fl through 

of the screen. RG. 6 illustrates an example of an effective 373^ when the upper limit has been reached or steps 374a 

region. A portion on the screen A excluding one block in the through 374e when the lower limit has been reached as 

left and right and one upper block is set as an effective region 45 shown in FIG. 3C. The zoom/focus controller controls the 

B. One block can be constituted by 8x8 pixels. The FIG. 6 camera 1 to perform a zooming operation as long as the last 

embodiment of an effective region can be applied to a video zooming step is not reached, until the object is included in 

telephone or a video conferencing system where variations the predetermined effective region. (Steps 373a-373rf or 

of the object are small and distance travelled by the object Steps 374^-374^/.) The same functions are performed in the 

is relatively small. In these exemplary applications, the 50 steps 373fl through 373rf or steps 374a through 374^ as those 

object is the upper half of the body or full body. Therefore, of the steps 371fl through 371d. When the uppermost limit 

it is preferable that the effective region is set as the a portion has been reached, step 373e drives the vertical tilt carrier one 

excluding the left and right ends and a part of the upper end step in the lowering direction. When the lowermost limit has 

of the screen. The effective region can be established accord- been reached, step 374e drives the vertical tilt carrier one 

ing to the field of application in which the apparatus is to be ss step in the upward direction. The zoom/focus controller 6 

used. controls the program to retmn to the step 340, detecting 

If the object is included in the predetermined effective subsequent frames for motion when the step 373e or 374e is 

region in step 2>l\d, the zoom/focus controller 6 judges that completed. 

the camera 1 has tracked the object correctly. Zooming Meanwhile, if none of the sensors 13, 14, 18 and 19 are 
ceases and the pan motion carrier U is rotated one step in a 60 activated because none of the limits of the horizontal left and 
direction opposite to the previous rotational direction. For right rotational range and the vertical upper and lower 
example, when the left-end limit has been reached, the rotational range have been reached, the zoom focus control- 
camera is rotated a step to the right direction (step 371e). ler 6 compares whether a region ratio (to be described 
The rotation in the opposite direction prevents the position below) is smaller than a predetermined value (step 375). 
sensor from being activated continuously. At the same time, ss When none of the sensors is detected, this means that the 
the zoom/focus controller 6 adjusts the AF lens using the object exists in the search region of the camera. The step 375 
maximum value of the liuninance component in the received prevents the object from being reduced excessively within 
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the search region. The region ratio coaesponds to a ratio of 
the region occupied by the object in the effective region with 
respect to the size of the effective region. A predetermined 
value sets a preferred ratio occupied by the object in the 
effective region. 5 

If the region ratio in step 375 is smaller than the prede- 
termined value, this means that the object has been exces- 
sively reduced. 

If the region ratio is not less than the predetermined value, 
this means that the object is included in the effective region 
and has at least a minimum desired size for searching by the 
camera 1. Accordingly, the zoom/focus controller 6 returns 
to the step 340 and controls the camera 1 to detect a 
subsequent image frame of the object to begin determining 
a motion vector for the object. 

Meanwhile, if the region ratio is smaller than the prede- 
termined value, and the object size is reduced excessively 
compared to the size of the effective region, the zoom focus 
controller 6 controls the zoom lens to perform a zooming 
operation one step in the lelephoto direction to enlarge the 
image of the object one step (step 376). The steps 375 and 
376 are repeatedly performed until the region ratio becomes 
not less than the predetermined value. When the zoom lens 
is adjusted in the telephoto direction, the ratio occupied by 
the object in the screen is enlarged and the search region of 
the camera is reduced. 

In the operational flow-charts of FIGS. 3B and 3C, the 
steps 371 and 372 for checking if the camera 1 has reached 
the limit of the horizontal rotational range, and the steps 373 
and 374 for checking if the camera 1 has reached the limit 3^ 
of the vertical rotational range can be reversed in their 
operational sequence. In other words, in the embodiment 
illustrated by FIGS, 3A through 3C, the horizontal limit 
position sensors 13 and 14 are first checked and then the 
vertical limit position sensors 18 and 19 are checked. 35 
However, the vertical limit position sensors 18 and 19 may 
be checked first, and then the horizontal limit position 
sensors 13 and 14 may be checked subsequently. Also, the 
operational sequences for checking the horizontal left and 
right limit position sensors and the vertical upper and lower 4^ 
limit position sensors can be reversed from that shown. 
However, the steps 375 and 376 should be performed after 
it is determined that none of the rotational limits have been 
reached to prevent the object size from being reduced too 
much. 45 

The apparatus according to the present invention detects 
a motion vector of an object between two sequential image 
frames within the limit of the horizontal and vertical rota- 
tional ranges of the camera and controls the camera to move 
in the direction and degree in correspondence to the detected 59 
motion. The apparatus adjusts the zoom lens to perform a 
zooming operation whenever the object is beyond the limit 
of the rotational range of the camera, to thereby enlarge the 
object search region of the camera compared to the prior art. 
Thus, the present invention provides effective automatic 55 
tracking of an object even when the object moves out of the 
ranges in which the camera can be panned and tilted. 

While only a preferred embodiment of the invention has 
been specifically described herein, it will be apparent that 
numerous modifications may be made thereto without 60 
departing firom the spirit and scope of the invention. 

What is claimed is: 

1. An apparatus for automatically tracking a moving 
object, the automatic tracking apparatus comprising: 

a camera including a zoom lens and an automatic focus 65 
lens, for converting an image of the object input 
through the lenses into electrical signals; 
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camera support means including: a camera driver on 
which the camera is mounted, said camera driver 
rotating the camera around a first axis between first and 
second rotation limits and a second axis between third 
and fourth rotation hmits, said second axis being per- 
pendicular to the first axis; and a rotation limit detector 
for detecting whether the camera reaches any of said 
first through fourth rotation limits and outputting a 
detection signal when one of said first through fourth 
rotation limits is reached by the camera; 

a first controller for comparing a current unit image output 
from the camera with a previous unit image, detecting 
a motion vector of the object, and controlling said 
camera driver so that the camera moves in a direction 
and degree corresponding to the motion vector; and 

a second controller for adjusting the zoom lens in a 
direction for expanding an object search region of the 
camera whenever the camera reaches one of said first- 
through fourth rotation limits, thereby allowing the 
camera to track the moving object, and adjusting the 
automatic focusing lens using a luminance component 
of the image received in the camera, 

wherein said camera support means comprises: 

a base; 

said camera driver including a first motion carrier 
mounted on said base and connected to a first motor via 
a first shaft, for rotating said camera in the horizontal 
direction as the first motor rotates, and a second motion 
carrier mounted on said first motion carrier and con- 
nected to a second motor via a second shaft distin- 
guished firom said first shaft, for rotating said camera in 
the vertical direction as the second motor rotates; and 

said rotation limit detector including said first and second 
motion carriers, each having a hole formed therein, a 
position sensor provided at each of the first and the 
second rotation limit positions of the first motion 
carrier and a position sensor provided at each of the 
third and fourth rotation limit positions of the second 
motion carrier for outputting a detection signal if the 
hole of one of the first and second motion carriers 
reaches the position of one of the sensors as the motion 
carriers rotate. 

2. The apparatus according to claim 1, wherein said 
second controller continuously performs a zooming opera- 
tion in the direction of expanding the object search region of 
the camera until the object is included in a predetermined 
effective region. 

3. The apparatus according to claim 2, wherein said 
predetermined effective region is a region for determining 
whether the object approaches the center of a screen of the 
camera. 

4. The apparatus according to claim 3, wherein said 
effective region is set at a proper configuration in advance 
according to a use to which the apparatus for automatically 
tracking the moving object is to be applied, in which the set 
configuration is set equal to or smaller than the carhera 
screen. 

5. The apparatus according to claim 2, wherein said 
second controller judges that the object is beyond the object 
search region of the camera when the object is not included 
in the predetermined effective region and the zoom lens 
reaches a zooming limit; and 

wherein the second controller initializes the camera when 
the object is judged to be beyond the object search 
region of the camera. 

6. The apparatus according to claim 2, wherein said 
second controller performs a zooming operation in a direc- 
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lion that enlarges an appearance of the size of the object until 
the region ratio becomes greater than or equal to a prede- 
termined value, said region ratio corresponding to an area 
occupied by the object with respect to the effective region, 
in order to prevent the appearance of the size of the object 5 
from being excessively reduced in size. 

7. A method for automatically tracking a moving object 
for use in an apparatus including a camera having a zoom 
lens and an automatic focus lens, for converting an image of 
an object into electrical signals, a driver for rotating the 
camera in at least two directions which arc orthogonal to 
each other, a detector for detecting limits of the rotational 
range in each direction of the camera and controllers for 
controlling the camera, the driver and the detector, the 
automatic object tracking method comprising the steps of: 

(a) comparing sequential unit images of the object with 
each other, detecting a motion vector of the object, 
generating camera control signals corresponding to the 
detected motion vector, and controlling the camera to 
track the moving object; and 

(b) performing a zooming operation in a direction for 20 
expanding an object search region of the camera until 
the object is positioned within a predetermined effec- 
tive region whenever it is checked that the camera 
reaches a limit of one of the rotational ranges of the 
camera, 25 

wherein said step (b) comprises: 

(bl) checking whether the camera reaches a limit of the 
rotational range in at least one direction; 

(b2) continuously performing a zooming operation in the 
direction of enlarging the object search region of the 30 
camera whenever the camera reaches the limit of the 
rotational range in at least one direction in said step 

(bl); 
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(b3) judging whether the object is included in a prede- 
termined effective region said step (b2X continuously 
perfonming a zooming operation until the object is 
included in the predetermined effective region, and 
rotating the camera one step in the direction reverse to 
the previous rotational direction once the object is 
included in the predetermined effective region, to then 
stop the zooming operation; and 

(b4) initializing the camera if the object it is not included 
in the effective region and the zoom lens reaches a 
zooming limit. 

8. The method according to claim 7, wherein if the camera 
does not reach a limit of the rotational ranges with respect 
to all directions in the result of said step (bl) and a region 
ratio is smaller than a predetermined value, said region ratio 
corresponding to a ratio of the region occupied by the object 
with respect to the effective region on a camera screen, a 
zooming operation is continuously performed in a direction 
of enlarging the size of the object until the region ratio is 
larger than the predetermined value. 

9. The method according to claim 7, wherein said step 
(bl) judges that the camera reaches a limit of the rotational 
rangps in at least one direction of the camera if at least one 
sensor installed at positions corresponding to the limits of 
the rotational ranges of the camera is activated, 

10. The method according to claim 7, wherein the pre- 
determined effective region of said step (b3) is a region set 
to determine whether the object is positioned in a center 
portion of a camera screen. 

* ♦ * ♦ * 
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